Papers by Sai Satyam Jena
ResoDiff-44k: High-Fidelity Cross-Lingual Speech and Singing Synthesis via Discrete Diffusion (2026.acl-industry)
Copied to clipboard
| Challenge: | generative speech models have a fidelity ceiling that is capped at lower sampling rates . current models rely on intermediate mel-spectrograms, which discard phase and high-frequency information . a new framework that synthesizes industrial-grade 44.1kHz audio is proposed . |
| Approach: | They propose a production-grade generative foundation model for 44.1kHz audio synthesis . they pre-train ResoDiff-44k on a massive 150K -hour multilingual dataset . |
| Outcome: | The proposed model achieves 4.6 mean opinion score in 44.1kHz singing synthesis compared to baselines . it also reduces character error rate on regional mixed-language and singing prompts compared with baselines. |